PATENT APPLICATION 

MATCH BLUR SYSTEM AND METHOD 
CROSS-REFERENCE TO RELATED APPLICATIONS 

This application is related to U.S. Provisional Patent Application Nos. 60/180,036, 
entitled "Match Blur System and Method, filed on February 3, 2000. This application is related 

to U.S. Provisional Patent Application Nos. , entitled "Digital Imaging With Sheep 

and Shepherd Artifacts"; , entitled "Reducing Streaks in Scanning"; and 

, entitled "Pyramiding and Digital Imaging System and Method," each of the 

same inventor hereof, and filed concurrently herewith, and those respective applications are 
incorporated herein. This application is also related to U.S. Patent Application Nos. 09/255,401, 
entitled "Parametric Image Stitching", filed on February 22, 1999, and 09/247,264, entitled 
"Image Block Windowed Blending", filed on February 10, 1999, each of the same inventor 
hereof and incorporated herein. This application is also related to U.S. Patent Application No. 

— > entitled "Method to Remove Magenta Stain From Digital Images", assigned 

to the same assignee hereof, filed concurrently herewith, and incorporated herein. 

FIELD OF THE INVENTION 

The invention generally relates to signal processing and, more particularly, to improving 
results from blur operations with digital artifacts of an analog signal, by guiding noisy artifacts 
by less noisy artifacts and clamping overly emphasized properties, for example, in digital film 
processing. 

BACKGROUND OF THE INVENTION 

In blurring operations, digital separations or channels (also referred to herein as 
"artifacts") of analog signals, such as digital artifacts respectively exhibiting various 
characteristics or properties of an analog image, are refined or enhanced by averaging over a 
spatial area each point (e.g., pixel) of the digital result. For each pixel represented in a digitized 
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image or artifact, for instance, the particular pixel is averaged with a surrounding region of 
adjacent pixels to obtain a new value for the particular pixel. When such blurring is performed 
for all points in a digital artifact, the intended result is a more expressive and refined digitization. 

Blurring can sometimes distort, however, rather than improve the digital result. In 
digitization of an image, a resulting digital image can be further distorted, rather than enhanced, 
in certain spatial locations of the image, for example, blurring near edge lines or borders can 
yield unintended results from the averaging operation. This is because each pixel is replaced 
with an average for an area surrounding the pixel, and dramatically varying features within the 
area can skew the average. Additional techniques are required to correct the unintended results. 

Certain blurring operations, particularly in digital imaging, can cause mottle effects, such 
as magenta mottle. Mottle refers to spotting or blotching. In digitization of images, such as in 
digital film processing, various factors can affect mottle in the result. The tone magenta in 
images from digital film processing is particularly problematic in mottle effects. 

It would be an advantage and improvement in the art and technology to provide systems 
and methods for performing blurring of digital images that reduces chances of unintended results 
in spatial vicinities of significant features and also in mottle effects. 

SUMMARY OF THE INVENTION 

An embodiment of the invention is a method of blurring a digital image. The method 
includes separating the image into noisy artifacts and less noisy artifacts, averaging the less noisy 
artifacts over a spatial range for each pixel of the image, and guiding the noisy artifacts by the 
less noisy artifacts in the step of averaging. 

Another embodiment of the invention is a method of blurring. The method includes 
deriving a noisy artifact, selecting a less noisy artifact, subdividing the noisy artifact into a 
plurality of windows, subdividing each of the plurality of windows into a plurality of squares, 
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subdividing the less noisy artifact into a plurality of windows corresponding to the plurality of 
windows of the noisy artifact, subdividing each of the plurality of windows of the less noisy 
artifact into a plurality of squares corresponding to the plurality of squares of the noisy artifact, 
determining a difference between a square at a centrum of a window of the less noisy artifact and 
another square within the window of the less noisy artifact, weighting a value for the square 
based on the difference, summing all of the values for the square as so weighted, multiplying a 
value for the square of the window of the noisy artifact by the result of the step of summing, 
summing all of the results of the step of multiplying for each square of the window of the noisy 
artifact, and dividing the result of the step of summing all of the results, by the result of the step 
of summing all of the values for the square. 

Yet another embodiment of the invention is a method of blurring. The method includes 
guiding a noisy artifact by a less noisy artifact. 

Another embodiment of the invention is a method of blurring. The method includes 
weighting a value in a blur region. 

Another embodiment of the invention is a method of signal processing. The method 
includes deriving a noisy artifact and a less noisy artifact from an analog signal and guiding the 
noisy artifact by the less noisy artifact. 

Yet another embodiment of the invention is a system for blurring. The system includes a 
noisy artifact, a less noisy artifact, wherein spatial locations of the less noisy artifact corresponds 
to locations of the noisy artifact, and a computer for guiding the noisy artifact by the less noisy 
artifact. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is an illustration of an exemplary image, such as can be imprinted in a 
photographic film, illustrating spatial relationships of portions thereof, according to 
embodiments of the present invention; 

5 FIG. 2 is an illustration of digital artifacts derived from a separation process with an 

image, wherein noisy (sheep) artifacts and less noisy (shepherd) artifacts result, according to 
embodiments of the present invention; 

FIG. 3 is a side-view of an image, like that of FIG. 1, illustrating a superimposed density 
curve and blur plot about a point (i.e., pixel) and illustrating a blurring to obtain a single 
10 averaged value for the pixel, according to embodiments of the present invention; 

FIG. 4 illustrates a noisy artifact and three less noisy artifacts and locates corresponding 
points of each such artifact that are correlated in a blur method, according to embodiments of the 
present invention; 

FIG. 5 is a flow diagram of a method of blurring, according to embodiments of the 
15 present invention; 

FIG. 6 is a more detailed flow diagram of an embodiment of the method of the flow 
diagram of FIG. 5, and illustrating a method to de-emphasize a particular property of magenta 
mottle exhibited by certain artifacts employed in the blur, according to embodiments of the 
present invention; 

20 FIG. 7 is a graph showing an example comparison of effects in artifacts exhibiting the 

particular property for de-emphasis in the method of FIG. 6, according to embodiments of the 
present invention; and 
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FIG. 8 is a graph illustrating sheep and shepherd artifact guiding effects and clamping in 
order to de-emphasize the particular property in the method of FIG. 6, according to embodiments 
of the present invention. 

Skilled artisans appreciate that elements in the figures are illustrated for simplicity and 
5 clarity and have not necessarily been drawn to scale. For example, the dimensions of some of 
the elements in the figures may be exaggerated relative to other elements to help improve the 
understanding of the embodiments of the present invention. 

DETAILED DESCRIPTION 

When analog signals are scanned or otherwise separated or channeled into digital data 
- 10 sets (herein referred to as "artifacts"), the resulting artifacts will, to varying degree, inexactly 
model the continuous analog signals, because of the discrete nature of digital signals. For 
example, digital images derived from analog images can exhibit differences of distortion or noise 
that limits quality of color, lines, structure and other feature or property expression. An 
operation to enhance digital signals, such as a digital image, derived from analog signals, such as 
"15 an exposed photographic film, is referred to as "blurring". In blurring operations, for example, 
with a digital file of an image, the digital image is blurred by independently averaging all pixels 
within a region surrounding each pixel of the image, and replacing each pixel with the averaged 
result for the pixel. 

Transition effects, such as edge lines in an image, can cause blurring procedures to 
20 undesirably distort the averaged result for the regions of pixels at the transitions. Also, certain 
properties, such as the color magenta, can be expressed more significantly than desired in the 
resulting digital product as mottle. These problems and others can be reduced by employing a 
relatively less noisy digital artifact (shepherd artifact), in comparison to other noisy digital 
artifacts (sheep artifacts), to guide a blurring operation. Additionally, special techniques of 
25 clamping the expression of a certain property exhibited by the artifacts, such as the color 
magenta, can reduce the undesired over-expression of the property, for example, as mottle, in the 
result from the blur. 
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Referring to FIG. 1, an analog signal is illustrated as an image 100 imprinted in a 
photographic film 102. The image 100 depicts a diamond shape 104 in a centralized portion of 
the film 102. A window 106 is shown at an edge of the shape 104 of the image 100. The 
window 106 is not actually exhibited in the image 100, but is intended merely to illustrate a 
5 single, spatial location of the image 106 (for example, a point located at a center of the window 
106) and a defined area adjacent that location (in this case, exemplified by the square shape of 
the window 106). Although the window 106 is square, that shape is intended merely as 
exemplary, as the window 1 06 could be any other desired shape. 

Referring to FIG. 2, scanning and other digitization of analog signals, such as images, can 
10 provide separations of various properties of the signals that are exhibited by digital data sets (or 
artifacts), for example, artifacts of a scanned image. As described in the related applications and 
patents, pluralities of artifacts can be segregated into noisy (sheep) artifacts and less noisy 
(shepherd) artifacts for various properties of interest of the analog signal. These sheep and 
shepherd artifacts can be obtained and derived from scanning or other operations. In the 
15 particular application of digital photographic film processing, a scanner scans a photographic 
film at instances during the film development process. The scan yields scanned results that 
provide grainy and luminous noisy (sheep) channels, such as a red, green and blue channel at 
various instances in time during film development, and also can provide channels that are highly 
definite in exhibiting detail and edges, such as a relatively noiseless (shepherd) channel for each 
20 of those colors at certain instances in time. The digital artifacts can be manipulated, for example, 
the sheep artifacts can be averaged and a best one of the shepherd artifacts can be selected, so 
that the shepherd artifacts can guide the sheep artifacts in order to produce an improved resulting 
digitized image. 

In an exemplary three-color (e.g., red, green and blue) system in digital imaging, a 
25 representative sheep artifact 202 is derived, such as a red sheep artifact which is an average of 
artifacts exhibiting the color red. The particular representative sheep artifact 202, in any 
instance, can be derived as an average, some weighted or proportional sum, or some other 
selection of, from, or among multiple artifacts. The representative sheep artifact 202, for 
example, has corresponding shepherd artifacts 204, 206, 208, such as a red shepherd, a green 
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shepherd, and a blue shepherd artifact, in the case of the three-color system and the exemplary 
red sheep artifact. Each of the colors of the system, such as green and blue in addition to red, 
will also have a particular representative sheep artifact 202 and several shepherd artifacts 202, 
205, 208 for all colors that are associated with the color. As described in the related applications, 
5 each of the shepherd artifacts is developed to guide the sheep artifacts to yield desired results. 
The same beneficial effects of guiding noisy channels (sheep artifacts) by less noisy channels 
(shepherd artifacts) can be employed to reduce undesired blurring results, such as skewed 
averages in a vicinity of strong features, and to suppress noise in the image 104, such as mottle 
of magenta or other color, as later described herein. 

10 Referring to FIG. 3, a blurring operation 300 is explained through illustration. In the 

operation 300, an image 302 is subjected to blurring. In the blurring operation 300, each pixel, 
such as a pixel 304, of the image 302, is averaged over a region surrounding the pixel 304 to 
obtain a new value for the pixel 304. The average is indicated by the curve 306. 

A square window 308 superimposed over the image 302 in the Figure is illustrative of the 
15 averaging operation for the pixel 304. As shown in the illustration of the window 308, a new 
value for the pixel 304 is obtained as an average, for example, a weighted average determined 
from calculations involving the pixel 304 and surrounding pixels within the square 308. The 
window 308, in an 8-bit imaging instance, is 8-bit by 8-bit in area. For the single pixel 304, 
therefore, a blurring operation can involve numerous calculations, on the order of 64 or more. 
20 Of course, the entire image 302 can be composed of a significant number of pixels, substantially 
increasing the number of calculations necessary to perform blurring of the entire image 302. 
New values are determined for each pixel of the image, in the same manners as for the pixel 304, 
and each such pixel of the image 302 requires the numerous calculations as for the single pixel 
304. 

25 Referring to FIG. 4, several artifacts 400 are employed in the blurring operation 300 of 

FIG. 3 according to embodiments of the present invention. In FIG. 4, a representative sheep 
artifact 402, like the sheep artifact 202 of FIG. 2 for the color red, is illustrated in an enlarged 
and partial view format. The sheep artifact 402 includes a window 404 superimposed on the 
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artifact 402 at a particular spatial location. Shepherd artifacts 410, 420, 430 corresponding to the 
sheep artifact 402 are also illustrated in similar enlarged and partial format. Windows 414, 424, 
434 are each spatially located in the respective shepherd artifacts 412, 422, 432 at the particular 
location of the shepherd corresponding to the particular location of the sheep. 

5 Each window 404, 414, 424, 434 has at its centrum a corresponding index 406, 416, 426, 

436, respectively. Each window 404, 414, 424, 434 is for purposes of performing calculations, 
sub-divided into a number of small squares or other shapes (e.g., squares 408) of spatial area 
within the respective window 404, 414, 424, 434, for example, 64 squares. The index 406, 416, 
426, 436 identifies the particular window, 404, 414, 424, 434, and also identifies the small 

10 squares (e.g., square 408) of spatial area within the window 404 that is the centrum. Each 
artifact 402, 412, 422, 432 is similarly divided into the respective windows over the entire area 
of the artifact 402, 412, 422, 432, and each window over the entire area of the respective artifact 
402, 312, 422, 432 is similarly divided into the respective squares over the entire area of the 
respective window. It is notable that there are corresponding windows and squares within the 

15 windows as to spatial location, for each of the artifacts 402, 412, 422, 432. The plurality of 
artifacts, windows over the area of the artifacts, and squares over the area of each window are 
used in performing a blur hereinafter described. 

Referring to FIG. 5, a method 500 performs a match blur. The term "match blur", as 
used herein, refers to a guiding of the blurring calculations for any given pixel by the method 

20 500. In a step 502 of the method 500, sheep and shepherd artifacts of an image are derived. The 
derivation of sheep and shepherd artifacts in the step 502 is further detailed in the related 
applications and patents. In general, sheep artifacts exhibit significant noise and color, whereas 
the shepherd artifacts are relatively noiseless and exhibit primarily lines and edges. A 
representative sheep artifact is selected from a plurality of sheep artifacts, for example, by an 

25 averaging calculation for the plurality or by some other selection process. 

In a step 504, one or more shepherd artifacts from the step 502 are used to guide the blur 
region for each particular location, e.g., each square of each window, of a representative sheep 
artifact. The blur region, as so defined, corresponds (for example purposes) to the square 106 of 
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FIG. 1, shown in respective sheep and shepherd artifacts 202, 204, 206, 208 in FIG. 2 as squares 
202a, 204a, 206a, 208a, and respective sheep and shepherd artifacts 402, 412, 422, 432 in FIG. 4 
as squares 404, 414, 424, 434. In general, the shepherd artifacts serve to indicate edges in the 
vicinity of the particular window and the blurring for the window is limited where such 
5 transitions are dictated by the shepherd artifacts. By so guiding the blur with the shepherd 
artifacts, the problems of skewed averages in blur calculations are reduced in areas in the vicinity 
of transitions such as edge lines. 

In a step 506, a first averaging of values for each window having an index and respective 
squares is accomplished through shepherd guide of sheep and yields a refined sheep artifact. In a 
10 step 508, the refined sheep artifact is again guided by the shepherd artifacts in a second 
averaging operation. From the guiding step 508, a resulting sheep artifact is obtained. The 
method 500 is performed for each of the respective sheep artifacts of an image. The several 
resulting sheep artifacts from the method 500 can then be recombined, for example, according to 
the procedures of the related patents and applications. 

15 Referring to FIG. 6, a method 600 details each of the guiding steps 504, 508 of the 

method 500 of FIG. 5. The method 600 is performed at each of the steps 504, 508 for each of the 
representative sheep artifacts. In a step 602 of the method 600, an initialization of a value "k" is 
performed for each shepherd artifact. If the representative sheep artifact is not representative of 
a property, for example, the color green, that tends to be over-expressed in blur results, such as 

20 magenta mottle, then k=l for each shepherd artifact. Otherwise, k=2 for each shepherd artifact. 
The variable "k" is employed in later steps of the method 600 as a weighting factor. 

In a step 604, an absolute value of a difference determination between a value of the 
center square (i.e., index) of a window of the shepherd artifact and another square of the window 
is determined for each square of each window. In a step 606, the absolute value of the difference 
25 for each sequence of each window is then weighted by multiplying the difference value by the 
weighting factor "k" from the step 602. The absolute value determination and weighting is 
performed over the entirety of each shepherd artifact, that is, square-by-square, through window- 
by-window, over the entire artifact. 
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The weighted difference values from the step 606 are then each limited by the product of 
one over a threshold factor. The threshold factor is determined empirically and can vary for the 
particular application and desired result. In every event, the threshold factor is chosen to yield a 
value between one and zero when the weighted difference values are multiplied by one over the 
5 threshold factor. 

In a step 610, a new weighted value of either zero or one is derived by setting the new 
value at 0.0 when the original product of weighted value times one over threshold factor is 
greater than one and at 1.0 when the original product is less than one. This clamps the weighted 
value between one and zero, as illustrated by a step 612. 

10 All of the weighted values, after clamping in step 612, are summed in a step 614 for each 

respective square. For the representative sheep artifact, the squares of the sheep artifact at the 
corresponding locations are also summed. A product sum is calculated for each square, which 
product is the sheep artifact at the square multiplied times the clamped and summed weight for 
the square. The clamped weight values from the step 612 are saved in a step 616 for each 

15 square, such as in an array. The saved clamped weight values from the step 616 are later used 
only in the event of performing the method 600 with the sheep artifact that would otherwise be 
overly expressed in the result, such as the green sheep artifact that leads to magenta mottle if the 
method 600 is not followed in the blur. 

In effect, the weighting and clamping of the foregoing steps of the method 600 serves to 
20 cause the weight for each window saved in the step 616, to approach the value of either 0 or 1 for 
the window. Because the weight is either 0 or 1 , the sum of the weights for each square will only 
become large if the absolute value of the difference of the respective squares of the shepherd 
artifacts approach the value zero. That is, the sum of the weights is large only if the shepherd 
artifacts agree at the particular square and, thus, at the particular window. If a feature exists in 
25 one shepherd artifact, but not the other shepherd artifact for the calculation, then the feature will 
be less emphasized in the resulting blur from the method 600 than will other feathers appearing 
strongly in both shepherd artifacts. This is the effect of the method 600, as just described, for all 
sheep artifacts; provided any sheep artifact, such as the green sheep artifact of an image, that 
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tends to be overly expressed in the result, for example, as magenta mottle in the case of the green 
sheep artifact, is further manipulated to limit the expression, as now described. 

If the sheep artifact in the method 600 is not one that tends to be overly expressed in the 
result, for example, it is not the green sheep artifact in imaging, then a new value is set and saved 
5 in step 618 for each window of the sheep artifact, which new value is calculated as the product 
sum of all squares for the sheep artifact times the clamped and summed weight for the square 
from the step 614 divided by the clamped and summed weight from the step 614. 

If, on the other hand, the sheep artifact in the method 600 is one that tends to be overly 
expressed, such as the green sheep artifact, then the method 600 proceeds to a step 620 or 622. 

10 For each square of each window of the sheep artifact, if the value for the square is less than the 
value at the centrum of the square, then the step 620 is performed. Otherwise, the step 622 is 
performed. In the step 620, if the value for the square is greater than zero, then the weight for 
the square is multiplied by a factor, such as 0.75. If the value for the square is less than zero, 
then the weight for the square is multiplied by another factor, for example, 0.20. The factor is 

15 empirically determined for the application. In a step 624, the weight as multiplied by the 
applicable factor from the step 620 is employed to derive a new value which is set and saved in 
the step 624 for each window of the sheep artifact. The new value, in this instance, is calculated 
as the product sum of all squares for the sheep artifact times the weight multiplied by the 
applicable factor from the step 620, divided by the weight multiplied by such applicable factor 

20 from the step 620. 

If the step 622 is performed, rather than the step 620, then the step 624 proceeds in the 
same manner as the step 618. That is, the new value is calculated as the sum of all squares for 
the sheep artifact multiplied by the weight and divided by the sum of the weight. 

Example code for performing the method 600 of FIG. 6 is attached and incorporated 

25 herein. 
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Referring to FIG. 7, the guiding of a sheep artifact 202, such as the red sheep artifact of 
FIG. 2, by one or more shepherd artifacts 204, 206, 208, such as the red, green, and blue 
shepherd artifacts of FIG. 2, can be understood with reference to some exemplary curve plots. 
The plots include a sheep artifact curve 702 and three shepherd artifact curves 704, 706, and 708. 

5 For purposes of example, the sheep curve 702 corresponds to a representative sheep artifact 202, 
such as a red sheep artifact. The shepherd artifact curves 704, 706, and 708 correspond to the 
shepherd artifacts 204, 206, 208, such as the red, green shepherd, and blue shepherd artifacts, 
respectively. As discussed in the related patents and applications, the shepherd artifacts 204, 
206, and 208 exhibit very little noise and are highly indicative of transitions, such as edge lines. 
10 The sheep artifact 202, such as the red sheep artifact, is primarily color and is very noisy. In 
FIG. 3, scanning distance for a particular point, such as that corresponding to the point of the 
pixel 304 of the image 302, is plotted against color density detected by the scanner. From the 
plot, it is apparent that the shepherd curves 704, 706, and 708 indicate clear transitions at a 
certain point "x" along the scan distance axis. This is indicative of a transition, such as an edge 

1 5 line, in the original image. 

The sheep curve 702, on the other hand, is a very irregular curve. Although the transition 
at "x" appears in the curve 702, the irregularity of the curve 702 does not so clearly locate the 
transition. In accordance with the embodiments described herein, one or more of the shepherds 
artifacts 204, 206, or 208, as depicted by the curves 704, 706, and 708, are employed to guid the 
20 sheep artifact 702, as indicated by the curve 702. By guiding the sheep artifact 702 with one or 
more of the shepherd artifacts 204, 206, and 208, the color of the sheep artifact 702 can be 
located more precisely in the digitized image because of the strong transition identification by 
the shepherd artifacts 204, 206, and 208. 

Referring to FIG. 8, treatment of a sheep artifact 202 that tends to be overly expressed in 
25 a result, such as the effect of magenta mottle from the green sheep artifact in imaging, is 
manipulated by a special technique that was described above. The effect of the special technique 
can be understood by the overlapping curves of FIG. 8. A curve 802 is an exemplary color 
density plot from scanning of the green sheep artifact. A curve 806 is a similar curve for a 
shepherd artifact that can guide the sheep artifact in the method 600. Because the method 600 
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offsets weighting in squares of the green sheep artifact, according to the steps 620 or 622 in the 
method 600, upper 802a and lower 802b extremes of the green sheep artifact 802 are limited, so 
that the resulting green sheep artifact from the method 600 is more akin to the curve 804. It is 
notable that the curve 804 does not exhibit the upper 802a and lower 802b extremes of the green 
5 sheep artifact before offsetting of weighting. This limitation, or clamping, of extremes reduces 
the extent of mottle, such as magenta mottle from the green sheep artifact. 

The foregoing description describes certain embodiments that are particularly applicable 
in digital film processing and other digital imaging operations. The same concepts are useful, 
however, in other contexts as well. In fact, the concepts can be applied generally to digital signal 
-10 processing applications, in particular, in instances of a plurality of artifacts exhibiting various 
properties of the analog signal, some more prevalently than others. In such instances, blurring 
steps can be guided by using shepherd and sheep artifacts. Furthermore, properties that tend to 
be overly expressed in a result can be reduced in effect by weighting and weight offsetting in a 
sheep artifact exhibiting the particular property. 

15 In the foregoing specification, certain specific embodiments have been described. Those 

of ordinary skill in the art will appreciate that various modifications and changes can be made 
without departing from the scope of the present invention as set forth in the claims below. 
Accordingly, the specification and figures are to be regarded in an illustrative rather than a 
restrictive sense, and all such modifications are intended to be included within the scope of the 

20 present invention. 

Benefits, other advantages, and solutions to problems have been described above with 
regard to specific embodiments. However, the benefits, advantages, solutions to problems and 
any element(s) that may cause any benefit, advantage, or solution to occur or become more 
pronounced are not to be construed as a critical, required, or essential feature or element of any 
25 or all the claims. As used herein, the terms "comprises," "comprising," or any other variation 
thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or 
apparatus that comprises a list of elements does not include only those elements but may include 
other elements not expressly listed or inherent to such process, method, article, or apparatus. 
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